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1. Introduction 

Consider the class of stationary linear processes 

oo 

Xi = 2jcfcej_fc, 

fe=0 

where € Z} is an i.i.d. sequence and X^^Lo l Cfc l < 00 • Assume that X\ has contin- 
uous distribution function F{x) = P{X\ < x) and let / and Q denote the associated 
density and quantilc function, respectively. Given a sample Xi, . . . ,X n , let F n (x) = 
— X^ILi l{Xi<x} anc * let Q n {y) denote the corresponding empirical quantile function. 
Define 

p n (x)=n 1 / 2 (F n {x)-F(x)), xeR, 
qn(y) = n^ 2 (Q(y)-Q n (y)), y e(0,l), 

the general empirical and the general quantile process, respectively. With Ui = F{X{), 
i> 1, let E n (x) = ^rY^i=i ^{Ui<x} = F n (Q(x)) and U n (y) be the uniform empirical dis- 
tribution and the uniform empirical quantile function, respectively. Let 

a n (x) = n 1/2 (E n (x) - x), x 6 (0,1), 
u n {y) = n 1 ' 2 {y-U n {y)), yG(0,l), 
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be the corresponding uniform empirical and uniform quantile process, respectively. 

Assume, initially, that Xi, i>l, arc i.i.d. Fix y G (0, 1). Let I y be a neighborhood of 
Q(y). Assuming that inf^g^ f{x) > and sup^,^ \f (x)\ < oo, Bahadur [2] obtained the 
representation 

f(Q(y))q n (y)-a n (y)~R n (y), (1) 

where R n (y) = O a . s (n~ 1 / 4 (logn) 1/ ' 2 (loglogn) 1 / 4 ). Later, Kiefer [11] proved that this can 
be strengthened to 

i?„(y) = O a .,>- 1 / 4 (loglogn) 3 / 4 ), (2) 

which is the optimal rate. Continuing his study, Kiefer [12] established the uniform version 
of (1), later referred to as the Bahadur-Kief er representation. For < a < b < 1, 

sup \f(Q(y))qn(y)-a n (y)\=:R n , (3) 

ye(a,b) 

where 

R n = Oo^n-^QognJ^togtogn) 1 /*). (4) 
The above rate is also optimal. Kiefer obtained his result assuming 

(Kl) sup yg(0it )|/(Q(tf))|<oo; 
(K2) inf w6 („,6)/(Q(y))>0. 

We shall refer to (K1)-(K2) as the Kiefer conditions. In particular, if a = and 6=1, 
(K1)-(K2) imply that / has a finite support. 

Further, Csorgo and Revesz [5] relaxed the conditions for Kiefer's result (3) and intro- 
duced the Csorgo-Revesz conditions (see Section 2; also cf. [4], Theorem 3.2.1). 

The main purpose of this paper is to obtain Bahadur-Kiefer-type representations for 
sample quantiles of linear processes with the optimal rate. Some results are available 
for weakly dependent random variables. For (/)-mixing sequences, under (K1)-(K2), the 
optimal rates have been obtained in [1]. These results were improved in [7] and [18] 
through less restrictive mixing rates and Csorgo-Revesz-type conditions. The rate of 
approximation was R n = O a . s ((logn) _A ) for some A > 0. 

Mixing is rather hard to verify and requires additional assumptions. In particular, to 
obtain a strong mixing for linear processes, both regularity of the density of ei and some 
constraints on the c^'s arc required (see, e.g., [6] or [15]). Nevertheless, even if we are 
able to establish strong mixing, we do not attain the optimal rate in the Bahadur-Kiefer 
representation. 

Another way of looking at linear processes is to approximate the sequence {Xi, i > 1} by 
a sequence with finite memory and then to use the classical Bernstein blocking technique. 
Hesse [8] obtained the Bahadur representation (1) with rate R n (y) = O a . s (n~ 1 / A+x ) for 
some A > via this technique. The method avoids some assumptions on the density of 
ei, but it leads to restrictive constraints on the c^'s and does not lead to the optimal 
rates. 
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Both the blocking technique and mixing require some strong assumptions. To over- 
come such restrictions, Ho, Hsing, Miclniczuk and Wu (see [9, 10, 16, 17]) developed 
martingale-based methods. In particular, for a class of linear processes, Wu [16] obtained 
the exact rate (2) in the Bahadur representation (1). He also studied the Bahadur-Kiefer 
representation, but was not able to obtain the optimal rate (4) due to the lack of an 
appropriate version of the law of the iterated logarithm for empirical processes. 

In this paper, we shall combine Bernstein's blocking technique with Wu's method to 
obtain the optimal rate in the Bahadur Kicfer representation (3) under quite mild con- 
ditions on the Cfc's. The result is stated in Theorem 2.1. The methodology involves the 
recent strong approximation result of Berkes and Horvath [3] . Since part of our compu- 
tation follows their proof, we include it in the Appendix. Further, we shall obtain the 
optimal rate, under general conditions on F, on the whole interval (0, 1) by considering 
an appropriately weighted process f{Q(y))q n {y) — oe n (y), as in Theorem 2.2. 

Throughout the paper, C will denote a generic constant which may be different at each 
appearance. Also, we write a n ~ b n if lim^—joo a n /b n — 1. For any stationary sequence 
{Zi,i > 1} of random variables, Z will be a random variables with the same distribution 
as Z\. 

Some further notation is required. Let 

b n = n- 1 / 4 (logn) 1 / 2 (loglogn) 1 / 4 

and 

A„=n- 1 / 2 (21oglogn) 1 / 2 . 
For any function h(x) defined on K and x < y, we write h(x,y) := h(y) — h{x). 

2. Results 

Assume that the following moment and dependence conditions hold. For a > 2, 

E|e| Q <oo (5) 

and for some p € (0, |), 

oo 

XV fe = o(r 2 /'(io g i)- 3 )- (6) 

k—i 

Theorem 2.1. Assume (5), (6) and (K1)-(K2). Furthermore, assume that for f e , a 
density of e, we have 

su P (Mx) + \f' e (x)\ + \f'J(x)\)<oo. (7) 

x6H 
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Then, 

sup \f(Q(y))q n (y) - a n (y)\ = O o ..(n- 1 / 4 0ogn) 1 / 2 (loglogn) 1 / 4 ). 

ve(o,6) 

To obtain the bound without the Kiefer conditions (K1)-(K2), we shall consider the 
following Csdrgo-Revesz conditions: 

(CsRl) / exists on (a,b), where a = sup{x : F (x) = 0} and b = ini{x : F(x) = 1}, 

— oo < a <b < oo; 
(CsR2) inf x6Ca , 6) /(as) > 0; 
(CsR3) (i) /(Q(y))~^ 1 ii(y- 1 ) asyiO; 
(CsR3) (ii) f(Q(y)) ~ (1 - v)t*Z 2 ((1 - y)- 1 ) as y 1 1; 
(CsR4) (i) < A := lim yl0 f(Q(y)) < oo, < B := lim^i /(Q(y)) < oo, or 

(ii) if A = (rcsp. i? = 0), then / is non-decreasing (resp. non-increasing) on 
an interval to the right of Q(0+) (resp. to the left of Q(l— )). 

Theorem 2.2. Assume Csdrgo-Revesz conditions with 7 := min{7i,72} > 1. As in The- 
orem 2.1, assume (5), (6) and (7). Then, for arbitrary v > max{27, 37 — 2}, 

sup (y(l - y)Y\f(Q{y))q n {y) - a n (y)\ = O^-^gn^ioglogn) 1 /*). 
ye(o,i) 

3. Proof of Theorem 2.1 

Let T% = cr(ej,ei_i,...). Note that F(x) = EF e (o; - X^-i) = EF e (x - -X"i j0 ). Also, let 
^(x) = F £ (a; - J?i,i_i) - We then have 

^Ea^}-^)) 

2—1 

= -Efe<-> - e(i {Xi < x} i^_ 1 )) + - 

i=l i=l 
=:M n (x)+N n (x). 

Then nM n (x), n > 1, is a martingale and N n (x) is differcntiablc. 

The plan of our proof is as follows. First, we obtain a strong approximation of the 
differcntiablc part N n by an appropriate Gaussian process. In order to do this, we will 
replace the original sequence {Xi,i > 1} with one having finite memory. From that ap- 
proximation, we will establish the uniform law of the iterated logarithm (ULIL) for the 
differcntiablc part N n , which, together with the ULIL for the martingale part M n , will 
imply the ULIL for the empirical process j3 n (see Section 3.1). 

Then, using a modification of Lemma 13 from [16], we will be able to control increments 
of the empirical processes (3 n and a n (Section 3.2), which, together with the ULIL, will 
imply the result (Section 3.3). 
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3.1. Approximation of the different iable part by a Gaussian 
process and laws of the iterated logarithm 

Proposition 3.1. Assume (5), (6) and (7). There then exists a centered Gaussian pro- 
cess K(x,i) with EK(x,t)K(y,t') =t At'T(x,y) such that 

sup sup |[nf]iV[ nt ](x) — K(x, [nt])\ = o(n 1 ' 2 (logn)~^) almost surely 
o<t<i xeR 

for some A > 0. 

The law of the iterated logarithm follows from Proposition 3.1 and the ULIL for K. 
Corollary 3.2. If (5), (6), (7) and Kief er conditions are fulfilled, then 

limsup — — p — —pr sup \q n (y)\=C almost surely. (8) 
n^oo (2 log log n) 1 ' 2 ye{0 1} 

Proof. Proposition 3.1, together with the ULIL for the martingale M n (see, e.g., [16], 
Lemma 7), yields 

limsup— — —-pr sup \/3 n (x)\=C almost surely. 

n-xyo (zloglogn) 1 /^ _ 00<2;<00 

Consequently, 

limsup 7Ti — T — u72 SU P \ u n(v)\ 
n^oo (21oglogn) i /^ y6(0 1} 

= limsup— — - — rj-^ sup \a n (x)\=C (9) 
n^oo (21oglogn) i /^ x£ ( ,l) 

almost surely. 

With A„,„ = Q n (y) - Q{y) 7 we have 



lim sup sup 



n 1 / 2 A 



ye(a,b) (loglogn) 1 /2 

... n 1 /2|Q( j p( Xfe:n ))-Q(fc/n)| 
< limsup sup — 

n->oo l<fe<« (loglog?!.) 1 /^ 

n^\Q(k/n)-Q(y)\ 
+ limsup sup sup — — 75 

rwoo l<k<nye((k-l)/n,k/n] (loglogn) 1 /^ 
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Now, if the Kiefer conditions hold, then sup e / 0)6 ) \Q"(y)\ < oo. Using Taylor's expansion, 
we obtain Q(|) = Q(y) + Q'(y)(± -y) + 0(±)'and 



Q^-Xfcn)) = Q(t/fc:„) = Q [ - ) + Q' ( - ) ( U k .. n --)+ O a . s [ [ U k , n - - 



Thus, by (9), 

,. n^A^ n^\U^~k/n\ 
hmsup sup - — —p- < sup \Q {y) hmsup sup — — —j-— < C. 

n^oo ye(a,b) (loglogn) 1 /^ ye(a,b) n^oo l<fc<„ (loglogn) 1 /^ 

Before proving Proposition 3.1, we need some notation. With p from (6), define 



□ 



Xi :=X l (p) = ^ c k Ej 



k=0 



Without loss of generality, we may assume that cq = 1. Let Xij-i = X^fcLi c fc £ i-fc an d 
define its truncated version -X^_i = Ysk=i Ck£i-k- 
By Rosciithal's inequality, for any a > 2, 



E\X,-X,\ a =E 



oo 

Cfce^fe 

fc=iP 



a/2 



(10) 



\k=iP 



k=iP 



This estimate is also true for EjX^-i — Xi,i_i| Q . Thus, replacing i with i p in (6), we 
have 



^\\\ <^0(*- 1 (log l )- 3 / 2 )<^ 

i— 1 i— 1 a i— 1 

and the same estimate is valid for || X^-i — X)"=i -^*,»— i||a- 
Define 

1 - 
n * — ' 

i=l 

a conditional empirical distribution function, and 

1 - 

K{x) = -Y J F e {x-X i ^ 1 ), 



(11) 
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its corresponding version based on the truncated random variables. 

Let Fi(x) := P(X, <x) = EF e (x — Xi : i-i), i>l. Since f e exists, we may define f*(x) 
dF*(x)/dx, f*{x) = dF*(x)/dx, /„(*) = i ELi dFi(x)/dx. 

Further, define Yi(x) = F € (x — X^i-x) — Fi(x) and 

1 n n 

ftn(x) = - J2(F e (x - X^r) -Fi(x)) = -Y^Yi{x). 

n * — ' n * — ' 



Lemma 3.3. Assume (5), (6) and (7). Then, for some Z?o > 0, 

\\nN n (x,y)\\ 2 2 <D Q n(y-x) 2 . 

Proof. We have, for any — oo < x < y < oo, 

rV 



\nN n {x,y)\\ 2 2 =n 2 E 



(£(u)-/(u))du 



<n 2 (y~x) 2 E sup |/» - f{u)\ 2 

x<u<y 

<Cn(y~x) 2 , 



by Lemma 9 of [16]. Next, 



(12) 



(13) 



E sup \f*(u) - f n (u)\ 2 < 3( E sup \f* n (u) - f* n (u)\ 2 

x<u<y \ x<u<y 

+ E sup \f:(u)-f(u)\ 2 + sup |/(«)- A(«)| a 

x<u<y x<u<y 

The second term is 0(n _1 ), as in (13). As for the first term, we have 



E sup |/*(«) - f*(u)\ 2 = JjE sup 

x<u<y " x<u<y 

1 



rr 



r E sup 

x<?i<2/ 



- - - *M-i)) 



n r-u-Xi j_i 

E / i» dv 



< ^ sup |/ e '(x)| 2 E (]T |X M _i - Ai-ill 

< - sup |/i(as)| 2 H^*.*-! - ( 15 ) 
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due to the fact that a > 2 and the comment following (11). Also, 

sup \f(u)-f n (u)\ 2 < sup E|/»-/,»| 2 <C-. (16) 

x<u<y x ^ u< ^y 

Combining (14), (15) and (16), we obtain (12). □ 

Next, we derive an exponential inequality for nN n (x,y). 
Lemma 3.4. Assume (5), (6) and (7). Then, for any z > 0, 



P 



>z\< C lZ - a + C 2 exp(-C 3 z 2 /(n(y - x) 2 )) + C 4 exp(-C 5 z/n p ), 



where Ci,C2,C3, 64,(75 are positive constants. 

Proof. Making use of differentiability and the comment following (10), we obtain 

/ / / 00 \ Q / 2 00 \ 1 / a \ 
\\F e (x - X M _0 - F e (x X M _!)|| Q = °( ( ( E c " J + E \ c x\ a ) J ■ 

Further, 

\F{x) ~ Fi(x)\ a < E\F e (x - X M _i) - F e (x - X M -i)| Q . 

Consequently, 

/ / / 00 \ Q / 2 00 \ V«\ 
||F,(aO-WII« = of M E C H +El^| Q J J 

and 

00 

||niV n (x) - nN n (x)\\ a < C := jN^Oogi) -3 ' 2 . 

i=l 

From this and the Markov inequality, we get 

P(|nAr„(x, y)| > z) < C z- Q + P(|niV„(x,y)| > z/2). 

To obtain the bound for the second part, divide [1, n] into blocks Ii, Ji, I%, J2, ■ ■ ■ , Im-i Jm 
with the same length n p , where p is defined in (6). Thus, M ~ n x ~ p . Let Uf. = 

Ziti k Yi(x,y), Vk =Y, ie j k Yi(x,y) and nN r [ 1] = ZlLi nN^ =Y%=i%> Both 
(Ui,...,Um) and (Vi,...,Vm) are vectors of independent random variables. Also, 
msxk=i,...,M Uk < [h] < Cn p . Equation (12) yields \\Uk\\\ < D n p (y — x) 2 . Recall that 
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p € (0, j). Applying the result from [13] page 293, to the centered sequence U\, . . . , Um 
with M n = n p and B n = D n(y — x) 2 , wc obtain 

P(\nN^ \ > z) < exp(-z 2 /(4,D n{y - x) 2 )) + cxp(-z/(4n p )). 

The same applies to P(\nNn \ > z) and hence the result follows. □ 

To state an approximation result, first note that Yq(x) and Yi(x), i> 1, are indepen- 
dent. Thus, we obtain 

\EY (x)Y i (y)\ < \EY (x)Y i (y) - Y (x)Yi(y)\ + \EY (x)Yi(y)\ 
< \\Yi(y)-fi(y)\\ a + 0. 

Then, in view of (6) and (17), 

CO 

T(x, y) = EY (x)Y (y) +J2(EY (x)Y i (y) + EY {y)Y i (x)) (18) 

i=l 

is absolutely convergent for all x, y £ K. 

Having Lemma 3.4, (18) and a > 2, we may proceed exactly as in [3] to obtain the 
approximation result of Proposition 3.1 (see the Appendix for details). 

3.2. Controlling increments 

Let l q (n) = (logn) 1 /«(loglogn) 2 /«, q > 2, and recall that \ c k\ < °°- 

First, we generalize Lemma 13 of [16], to the real line. 

Lemma 3.5. Assume (5), (7) and (K1)-(K2) . Let — oo < a < b < oo. Then, under Kiefer 
conditions, for any positive bounded sequence d n such that logn = o(nd n ), we have 



sup \F n (x) - F(x) - (F n (y) - F(y))\ = O a . s H d ^ n + ^IM) . (19) 

Proof. Define Ui = F(Xi). Clearly, in order to show (19), it suffices to prove that 



Let y € (01,61). Decompose 



. ^d n \ogn d n l q (n) . 
sup \E n (v) -v- (E n (u) -u)\ =O a . s \ — 1 )=— . (20) 



in \ n 



1 ™ 



n . 
i=i 
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1 n 

4=1 
1 " 

+ -T,^ 1 {u,<y}\^-i)-y) 



i=l 

=:M n (a)+JV" n (s), 



where 



i n 1 n 

iV„(2/) = - X;(E(l w < v} |^i-i) -!/) = - - X M -i) - y) 



i=l 



i=l 



so that 



and 



1 " 

n 

i=i 

n 

Kiv) = - Y,(Q"(y)fe(Q(v) - *m-i)) 

i=l 

n 

+ (Q'(y)) 2 -E/ e ^(y)- x M-i) 

T? ^ ' 



(21) 



(22) 



Define the projection operator V k £ = E(£|.F fc ) - E(^|J r fc _ 1 ). Let g y {Ti) = f t (Q(y) - 
As in the proof of Lemma 3 of [16], with a = q, 

\\Vog v (?i)\\ a = o{\c i \), 

uniformly in y € {a\,bi). The same holds for g y {Fi) = f' e (Q(y) — X^i-x). Further, under 
Kiefer conditions, sup y£ ^ ai bl ^(\Q'(y)\ + \Q"{y)\) < oo. Thus, applying Proposition 1 of 
[16], we have max ye (\\K(y)\\ a + \\K(y)\\ a ) = 0(n- 1 /2). Consequently, 



E 



max \N n (y)\ c 



<E 



\K(y)\dy 



= 0{n- a ' 2 ). 



Similarly, E[max ye ( aiibl ) \N n (y)\ a ] = 0(n Q / 2 ). Thus, by the same argument as in 
Lemma 9 of [16] we have sup ye(Ql >fel ) \N n (y)\ =o a . s (lq(n)/y/n). Further, 

sup \N n (v) -N n (u)\ <d n sup \Nn(y)\=o a . a (d n l q (n)/y/n). 

\u— v\<d n ,u,v$i(a\.bi) y£(ai,&i) 



This, together with appropriate estimates for the martingale part, yields (20). 



□ 
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We apply Lemma 3.5 with d„ = A„. The second part in (19) is then negligible. Thus, we 
have 

sup sup \0n(x)-0n(y)\=O a . s (b n ). 
x£R\x-y\<\ n 

On account of (8), it yields 

sup \p n (Q n (y)) - f3 n (Q(y))\ = O a . s (b n ). 

3/6(0,1) 

Equivalently. 

n 1 ' 2 sup \F n (Q n (y))-F(Q n (y))-(F n (Q(y))-F(Q(y)))\=O a . s (b n ). 

2/6(0,1) 

Since \F n (Q n (y)) - F(Q(y))\ < 1/n, we obtain 

n 1 ' 2 sup \F(Q n (y))-F(Q(y))-(F(Q(y))-F n (Q(y)))\=O a . s (b n ). 

Set A„ i3 , = Q n {y)-Q{y). Using the Taylor expansion F(Q n (y)) = F(Q(y)) + f{Q{y))A n>y + 
O a , s (A 2 l y ), we complete the proof of Theorem 2.1. □ 

4. Proof of Theorem 2.2 

Note that Q'(y) = and Q"{y) = Let h(y) = (y(l - y)f . Moreover, 

(h(y)N n (y))> = h'(y)N n (y) + h(y)N' n {v)- 

Thus, in view of (21), we need h'(y) and h{y)Q'(y) to be uniformly bounded, which is 
achieved by v > 1 and v > 7, respectively. Moreover, 

(h(y)N n (y))" = h"(y)N n (y) + 2h'{ y )N' n { y ) + h(y)N^(y). 

Thus, in view of (21) and (22), we need h" (y), h'{y)Q'{y), h{y){Q'{y)) 2 and h(y)Q"{y) 
to be uniformly bounded. The first claim is achieved by v > 2, the second by v — 1 > 7 
and the third by v > 2-f. As for the fourth, we have 

Since (CsR3(i)) and (CsR3(ii)) are fulfilled, the first part is O(l) uniformly in y <E (0, 1). 
The second part is O(l) since v — 1 > 27 — 1 > 7 (recall that 7 > 1). 
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Let g(y) = h(y)N n (y). Thus, proceeding exactly as in Lemma 3.5, we obtain 
E[max ye(0:1) x\g'(y)\ a ] = 0{n- a ' 2 ). Thus, sup. y6(04) \g'(y)\ = o a . s {l q {n) / yfn) and 

sup \g(v) - g(u)\<d n sup \g'(y)\ = o a . s (l q (n)/y/n). 

\u—v\<d„,u,ve(o,i) yet , 1 ) 

Further, by differentiability of h, 

sup \h(u)-h(v)\\N n (u)\<d n sup \N n {y)\=o a . s (l q {n)/yfn). 

u-u|<d T ,,u,j;e(o,i) ye(o,i) 



Consequently, 



sup h(v)\N n (v) - N n (u)\ =o a .s(lq(n)/Vn)- 

\u—v \ <d n ,u,u£ (0,1) 



Therefore, taking into account the martingale part and d n = A n , we have 



sup h(v)\(E n (v)-v) - (E n (u)-u)\=O a . s ( Vdn ^ gn ), (23) 

\v,-v\<x„,u,ve(o,i) \ V n J 

Note that 

u n {y) = V^(E n (U n (y)) - U n (y)) + O a . s { n - 1 / 2 ). 

Consequently, by (23) and (9), we have 

sup h{y)\u n {y) -a n {y)\ = sup h{y)\a n (U n (y)) - a n (y)\ + O a . s {n~ 1/2 ) = O a . s (b n ). 
«6(o,i) ye(o,i) 

Let (k - l)/n < y < k/n. Further, let <5„ = 2C*n~ 1 ^(log\ogn) 1 ^ 2 , C* = C, where C 
comes from (9). As in [5], with 9 = 9 n (y) such that \6 — y\ < n~ 1 / 2 u n (y) = O a . s (5 n ), 

sup h(y)\f(Q(y))q n (y)-u n (y)\ 

<" ™ (l2/ \/ 2 (Q(6»)) ^ ^/(Q(0)) 0(1-0) • 
In view of Lemma 1 of [5] , we have 

f(Q(y)) < ( yvfli-yAe ] 7 

/(QW) " UA01-yV0J ' 1 j 

Further, if y > 2S n , then 
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Consequently, by (CsR3(i)), (CsR3(ii)), (24) and (25), we have 

sup h(y)\f(Q(y))q n (y) - u n (y)\ ^ O a . s (n~ 1/2 loglogn). 

ye(5 n ,i-s n ) 

If 1 > Uk-.n > V, then 

sup h(y)\f(Q(y))q n (y)\ = sup n l ' 2 h{y) f du 

<C sup n 1 / 2 /^) f Ukn (-\\u 

ye(0,5„) \y/ 

<C sup n 1 / 2 Ul 1 + 1 h{y)y-^ 
ye(o,8 n ) 

= O a . s (n- 1/2 \og\ogn). 

Further, if Uk-.n < y, then for 71 > 1, 



and for 71 = 1, 



sup h{y)\f{Q{y)) qn {y)\<Cn x !Hl^U-^- 1] (26) 
»e(o,*») 



sup h(y)\f(Q(y)) qn (y)\<Cn 1 / 2 5» +1 \og(5 n /U k:n ). (27) 

ye(o,<5„) 



Now, 

n 

P(U 1:n < n- 2 (\ogn)- 3 / 2 ) <^P{U l < n- 2 {\ogn)- 3 / 2 ) < n' 1 (logji)" 3 / 2 . 

i—l 

Consequently, via the Borel-Cantelli lemma, Uk-. n — o a . s (n~ 2 (\ogn)~ 3 / 2 ). Therefore, the 
bound in (27) is Oa.sXn^ 1 / 2 log log n) and the bound in (26) is of the same order, provided 
that v > 371 — 2. The upper tail is treated similarly. Consequently, the result follows. □ 

5. Remarks 

Remark 5.1. Assume that Ck ~ fc~ r (logfc)~ 3 / 2 . Then, 

f:c 2 =f:fc-^(logfc)" 3 = 0(^- 2 ^(log^)- 3 ) 

k—i k—i 

and (6) is fulfilled if t>5/2. 

If Xi has all moments finite, then in [16], the summability assumption X^fcLo l Cfc l < 00 
provides the bound 0(n~ 3 / 4 (logn) 1 / 2+,? ), 77 > 0. 
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Remark 5.2. It should be pointed out that the process K(x,t) in Proposition 3.1 ap- 
proximates N n , not (3 n . We use this as a tool to achieve ULIL only. Using the blocking 
technique applied to f3 n directly, we may establish Proposition 3.1 with N[ nt ] replaced by 
([nt]) 1 / 2 /3[ nt ] and a different Gaussian process. However, it requires stronger assumptions 
than (6) on the coefficients c^. In particular, r > | + ^. Without exploiting differentiabil- 
ity, we must compare indicators applied to the original sequences Xi with the indicators 
applied to the truncated one (see, e.g., [3]). 

Remark 5. 3. The main part of this paper is devoted to the law of the iterated loga- 
rithm for the empirical process. One may ask whether, by imposing (6), we could ob- 
tain uniform law of the iterated logarithm for empirical processes via strong mixing. 
From [15], we know that if E|ei|" < oo, Ck = 0(k~ T ) and r > 1 + — + max{l, a -1 }, then 
a(n) = 0(n~ x ), where A = (ra — max{a,l})/(l + a) — 1 > and a(n) is the strong 
mixing coefficient. In particular, if a > 2, then this condition yields r > 2 + ^ and 
a(n) = 0{nr( Ta ~ 1 ~ 2a ^( x+a )). In view of Rio [14], to obtain the LIL for partial sums 
of bounded strongly mixing random variables, we need a(n) to be summable, which 
would require r > 3 + — • Thus, we need stronger conditions than (6). Also, Rio's result 
would provide the LIL for (3 n (x) at fixed x. 



Appendix 

Here, we reprove the strong approximation of Proposition 3.1. The proof is along the 
lines of [3] , thus we present only the major steps. 

We keep the notation from Section 3.1. Recall that ||X|| Q = (El^l") 1 /". For x = 
(xi, . . . , Xd) G R d , let ||x|| be the Euclidean norm and define the following random vectors 
in R d : 

& = (Yi( Xl ), Uxd)), li = {fi( Xl ), Yi(x d )). 

Denote the covariance matrix of by Td = Td{x) = (T(xi,Xj), 1 <i,j < d). We shall use 
the following implication, which is valid for any vectors £i, r\i in K d : 

E||^-??i||<^ implies |Eexp(i(u,&)) - Eexp(i(u, < ||u||A (28) 

Also, we will use the following bound: for Xj € M. d , i = 1, . . . ,n, we have || X) n =i x i|| ^ 

ELilWI- 



Lemma A.l. Under the conditions of Proposition 3.1, for all u£ 



Eexp [i/u^-^Y.cM -Eexpli/u^- 1 / 2 ^^ 



< llulld 1 / 2 ™- 1 / 2 . 



Proof. From (6) and (17), we have \\Yi(x) - Yi(x)\\ 2 < Cr^logi)" 372 . Thus, 



E|ie i -e i |i 2 <crfz- 2 (io g z)- 3 



(29) 
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and (29) implies that 

n\ti-ii\\<cd i ' a r i Qo S i)- a ' 2 . 

Therefore, 

n 

E <Cd>l\ 

i=l 

This, together with (28), implies the result. □ 
Proposition A. 2. Under the conditions of Theorem 3.1, for all u £ M. d , 

Eexp^n-^f^Aj -exp(-i(u, r d u) ) 

< Cd\\u\\n- Sl + C||u|| 2 ( ? i- 1 / 4 (logn)' i / 2 exp(Cd) + d d/2 exp(-Cn 1/2 )) 
for some Si > 0. 

Proof. Divide the interval [l,n] into consecutive long and short blocks I\, J\,l2, J%, ■ ■ ■ 
with lengths card{I k ) = [n p ], card(J k ) = [n p ], l<k<M,p<p*<\. Then, M = M n ~ 
n x ~ p (the last block is possibly incomplete). Define Uk — J2iei k £»i ^fc — J2iei k £« an d 

^ = J2ie.j k B y ( 29 )' we havc 

n\U k - U k \\ < ]T E||& - U < Cd 1 ' 2 ]T i^llogi)-*' 2 . 



(30) 



Note that fc = 1, . . . , M, are independent. Thus, we can construct independent random 
vectors Ui,...,U~m such that (Uk,Uk) = {Uk,Uk), k=l,...,M. By (30), we obtain 



E 



M 



E(^ - u k ) 



k=l 



A I 



<^E||[/ fc -J7 fe || <Cd>' 2 . 



(31) 



k=l 



Further, E||Vfc|| < dn p l 2 , which implies, by independence, that 



E 



M 



fc=i 



M 



< E || V k || 2 < C*dMn p = dn p+1 - p * . 



(32) 



We have 



k=l 



M 



M 



M 



i=l fc=l 



fc=l fe=l 
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Thus, by (31) and (32) 



E 



M 



i=i fe=i 



<C(d 1 / 2 + d^+ 1 -^/ 2 ). 



(33) 



Also, by Lemma 2.9 of [3] and the same argument as at the end of Lemma 2.10 in the 
same paper, we obtain 

E cxp U u, n- 1/2 V* \\ - ex P(- 1 (u, T d u) ) 

<Ci|u|| 2 (7i-( 1 -"*)/ 2 (logn) d / 2 exp(Cd) + d <i/2 exp(-C7i 1 - p *)). (34) 
Consequently, by (33), (28) and (34), the result follows. □ 



A.l. Approximation 

Let e G (0,1/4). Further, let i fc = exp(fc 1_E ), p fc = 2[t£], d fe = fc 1 / 2 and = (i - l)/d k , 
i £ Z. Define Mk = tk+i — tk~ Vk so that Mk ~ Cfc~ e cxp(fc 1_e ) and logMfe ~ Cfc 1_e . 
Define random vectors in R rffc , r\k = (77^1, . . . ,T]kd k ), where 



riu = R(xi,tk+i) - R(xi,t k +Pk)= ^2 Y A x i)- 

j=t k +p k +i 

Also, define m = Y%°=t h + Pk +iti( x i)- 
By Proposition A. 2, 

I E cxp(i (u, Mk 1/2 m })-exp(-i(u,r dfe u))| 

<C\\u\\\dkM k - pl +M- {1 - pt)/ \\ogMk) dk/2 cxp(Cdk)+di k/2 cxp(-CAll- 
<C*exp(-C/c 1 - £ )||u|| 2 . 

Let ijjpL be the Prokhorov-Levy distance. Choose T := exp(fc 6 ); for sufficiently large fc, 
T> I0 8 d k . Then, 

V^L(M fe " 1/2 %,A r (o,r (i j) 

16d fc 



< 



logT + P(JV(0,r d J>T/2) 



|u||<T 



du 



< 



T 

^logT + P(7V(0,r d J>T/2) + Cr £i '=exp(-fc 1 - £ ) / ||u|| 2 d U 



Eexp(i(u, A/ fc »7jt))-exp( --(u,r dfc u) 
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<Cexp(-Ck £ ) 
since e < 1/4. 

Since fc= l,...,Af, are independent, we can define independent random vectors 
Cm such that M~ 1/2 C k ~ JV(0, r d J and 

P(||M- 1/2 ?7 fc - A47 1/2 Cfc|| > Cexp(-fc e )) < Ccxp(-fc e ). 

This yields 

P(||M- 1/2 77 fc - M fc - 1/2 Cfe|| > Ccxp(-fc E )) < Ccxp(-fc £ ) 
and then, by the Borel-Cantelli lemma, 

— 1/2 

M k (Vk — Cfc) <exp(— fc 6 ) almost surely. (35) 

For fc > 1 , define random vectors .Z^ in M. dk by 

Z fe = (R(xi,t k+1 ) - R(xi,tk),i= 1, ■ ■ - ,<4)- 

Since — 77^ is the sum of random vectors in K d,! with coordinates bounded by 1 
and since M k < d]/ 2 p]J 2 < ktf/ 2 < exp(cfc 1_e ), e < 1/2, we have, by (35), 

\\z k -Ck\\<\\z k -vk\\ + \\vk-Ck\\ 

< C( d l /2 Pk 2 + tl /2 cx P (-fc £ )) < Ctl /2 exp(-Cfc e ). (36) 

Thus, the skeleton process {Z k , k > 1} can be approximated by the sequence {Ck,k>l}. 
The latter can be extended to a centered Gaussian process {K(x,t),x el,i>0} with 
covariance t A t'Td k (s, x') such that 

Cki = K(xi,t k+1 ) - K(xi,t k +p k ), i=l,...,d k . 

Define Y k = (K(xi,t k+1 ) - K(x t ,t k ),i = 1, . ..,d k ). Then, 

HCfc ~Y k \\< Ct 1 ,/ 2 cxp(-C7c £ ) almost surely 
by the last inequality on page 807 of [3]. Thus, by (36), 

|| Z k - Y k || < Ct]/ 2 cxp ( - Ck s ) almost surely. 

A. 2. Oscillations 

Lemma A. 3. Under the conditions of Theorem 3.1, for n > 1, A > n 1 / 2 and any —00 < 
a <b < co, we have 

p( sup y^Yi(x,x') >\\< Ccxp(-CA 2 /(?i(fe- a) 2 )) + — , 

\a<x<x'<6,0<fc<n^' / nV 
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where rj > . 
Proof. Define 



M u v = max 

0<i<2",0<j<2" 



Then, for any integer L>1, 



i=i 



«0 + l)2-" 

£ y fc (W2- t, ,6(i + l)2- 

k—nj2~ v 



E2n 

l<u,u<£ 



Choose 

0<e< (a-2)/(2C 6 ) (37) 

for some constant Ce to be specified later. Since n 1 / 2 < A, u,v < L, we have, by 
Lemma 3.4, 

P{M U , V > A2- s < u+ " ) ) 

< 2" + ' u C{(A2- e(tl+t,) )" Q + exp(-CA 2 2- 2£ ( u+t 'V(^2" t '(62- M ) 2 )) 
+ exp(-CA2- £ ( tl+l 'V(n2- l 7)} 

< 2" +u C*{n" 1 / 2Q 2 2,rLa + exp(-CA 2 2"( 1 - 2e )2 t, ( 1 - 2e V(^ 2 )) 
+ ( n (i/2-p) 2 -^(«+")2 1 'P)- r } 



for any r > 0. Choose 



Since u + u < 2L, we have 



For 



we have 



2(l/2-p))" 

P(M„,„ > A2- £ (" +w )) 

< 2 u + 1 'C{7i- Q / 2 2 2C£LQ + exp(-C*A 2 2 u ( 1 - 2£ )2 t '( 1 - 2£ ) /(n6 2 ))}. 



A = {M Ui „ > \2~< u+v ^ for some 1 < u,v < L} 
P(A) < T+V exp(-C*A 2 2 tl(1 - 2e) 2 t,(1 - 2e) /(nb 2 )) + 2 2L+2 2 

l<u,v<L 

<(j2 cxp(u-CX 2 2 u ^ 2 ^/(nb 2 ))\ + 2 L < 2+C 

\1<M<L / 



CLe n - a /2 



< Cexp(-CA 2 /(n6 2 )) + C 2 L{2+c ^n- a ^ 2 . 
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If we choose L so that n 1 / 2 < 2 L < 2?! 1 / 2 , then, by (37), the second part in the lat- 
ter expression is bounded above by Cn~ v , for some r\ > 0. Further, on A c , we have 
Ei<„,„<l M u,v < C 7 A and 

M U , V + ^<C 7 X + AX = C & X. 

Ku.v<L 



Therefore, the result follows. 
Let 

Ri tk — sup sup \R(s,t) — R(xi,tk)\- 

s£[xi,x i+1 ) t£[t k ,t k+1 ] 

Using Lemma A. 3, we obtain the following result. 

Lemma A. 4. Under the conditions of Theorem 3.1, for some e* > 0, 

~ 1/2 * 

max \Ri,k\<Ct k ' (logfc) _e almost surely. 

Ki<4 



□ 



A. 3. Conclusion of the proof 

For s G [xi,Xi+i) and t 6 [tk,tk+i], write 
\R(s,t) - K(s,t)\ < \R(s,t) - R(xi,t k )\ + \K(s,t) - K{x u t k )\ + \R{x h t k ) - K{ Xi ,t k )\- 

1/2 * 

Both the first and the second part are bounded almost surely by Ct k (logfc)~ £ , the 
first by Lemma A. 4 and the second by (2.55) in [3]. The second part is bounded in the 
same way as (2.56) in [3]. 
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